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Abstract 


Quickest change detection (QCD) aims to minimize the detection delay of an abrupt change in 
probability distributions of a random process, subject to certain performance constraints such as the 
probability of false alarm (PFA). It has a wide range of applications, such as wireless network data 
analysis, intrusion detection, anomaly detection, quality control, financial market analysis and medical 
diagnosis, etc. In this talk I will first give an overview of existing quickest change detection algorithms 
and discuss some of our recent results. Then I will present the application of QCD on the detection of 
bearing faults of wind turbines (WT). The QCD algorithm is developed by analyzing the statistical 
behaviors of stator currents generated by the WIs. It is discovered that, at a given frequency, the 
amplitude of stator current follows the Gamma distribution, and the presence of fault will affect the 
parameters of the Gamma distribution. Since the signature of a fault can appear in one of multiple 
possible frequencies, we need to monitor the signals on multiple frequencies simultaneously, and each 
possible frequency is denoted as a candidate. Based on the unique properties of WT bearing faults, we 
propose a new multi-candidate QCD (MC-QCD) algorithm that can combine the statistics of signals 
from multiple candidate frequencies. The new algorithm does not require a separate training phase, and 
it can be directly applied to the stator current data and perform online detection of various possible 
bearing faults. The theoretical performance of the proposed algorithm is analytically identified in the 
form of upper bounds of the PFA and average detection delay (ADD). 


Index Terms: Quickest change detection (QCD), wind turbines (WT), Change point detection 
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CHANGE POINT DETECTION 


* Change detection (or, change point detection, CPD) 


— Detect an abrupt change in a stochastic process 


time 


Change point 


The change can be due to a change in amplitude, mean, variance, or distribution, etc. 
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CHANGE POINT DETECTON 
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CHANGE POINT DETECTION 


* Applications: 
— Finance 
* stock market change from a bull market to a bear market 
— Wireless network 
* User behavior and traffic statistics change over time 
— Surveillance 


e target detection (change from no target to the presence of 
target) 


Intrusion detection 


* before intrusion, the data follows a certain probability 
distribution 


e After intrusion, the data follows a different distribution 
— Fault detection or anomaly detection 
e Normal data follows a certain distribution 


e Abnormal data follows a different distribution 
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CHANGE POINT DETECTION 


е Two types of change point detection 
— Offline detection 
* A sequence of data has been collected before hand 
* Find the change point somewhere in the data sequence 
— Online detection 
e The data are collected sequentially as time goes on. 
e New data are used to update certain test statistics 


* Use test statistics to determine whether a change has occurred 


INDEXCBOE: .INX - Mar 16, 4:39 PM EDT ж 
2,/92.01 *4.68 (0.1796) 
1 дау 5 day 1 month 3 month ] year 5 year max 
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CHANGE POINT DETECTION 


e Tradeoff in online change detection 


— Probability of false alarm (PFA): the probability that the true 
change point occurs after the detected change point 


— Detection delay (DD): once the change point happens, how much 
longer it takes to identify the change point 


— E.g. if we never detect the change point, then PFA = 0 and DD 1s 
infinity 
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CHANGE POINT DETECTION 


e Preliminaries 
— Consider a random process: 1,22, , Ры, , 
— There is an unknown change point: Ó 
En ~ fo(x4,), when n <9, 


En ~ fi(n), when n» 90 


— The change point 6 is random 


* Prior distribution of the change point 


ЛЕ — P(0 — k), for k= 1,2,--- Qt 


Change point |. 16 





CHANGE POINT DETECTION 
e Metrics: for a given detection procedure д 


0:0(12,,--- ,z,]) 9 lk: k nn 1,2,.-- 
— Probability of false alarm (PFA) 


— Average detection delay (ADD) 


ADD(6) = E 6 — l8 0 
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CHANGE POINT DETECTION 


* Problem formulation 
— Find the detection procedure ó 


e Minimize: ADD(ô) = E 6 - 910 > 0 


Subject to: PFA(ô) = P( < 0) < a 


UNIVERSITY OF 18 





CHANGE POINT DETECTION 
¢ Cumulative sum (CUSUM) Procedure 





— Where 


C41 = max(1, Cn) ae 


Co = 0. 


E. S. Page, "Continuous inspection schemes," Biometrika, vol. 41, 


pp. 100-115, 1954. 19 
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CHANGE POINT DETECTION 


* Shiryaev-Roberts Procedure 





— Where 


Sn+1 = (1 т sä = 


n > ] 


So = 0. 


S. W. Roberts, "A comparison of some control chart procedures," 


Technometrics, vol. 8, pp. 411-430, 1966. Sö 





CHANGE POINT DETECTION 


* Performance comparisons 


— Shiryaev procedure (Bayesian detection) 


ADD(0s) «зо D(fi||fo) + | log(1 — p)| 


— CUSUM and Shiryaev-Roberts Procedure (Minmax criterion) 


арузу у ПОО! 
ADDO) Xo DG: Iio) 


A. G. Tartakovsky, and V. V. Veeravalli, "General asymptotic Bayesian theory of quickest 
change detection,” Theory Probab. Appl., vol. 49, pp. 458-497, 2005. 
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CHANGE POINT DETECTION 


* Mismatched post-change model 


— [tis usually difficult to get an accurate estimate of the post-change 





distribution 
— Assume: 
true model after change: Л (2) 
estimated model after change: " (2) 
— The Kullback-Leibler divergence between true and estimated 
models: 
Л (5) 
D(fi||fi) = Ef, og og = 
^j 1 (x) 
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CHANGE POINT DETECTION 


¢ CUSUM Procedure with mismatched post-change model 


).(A) =6 =inf{n:C, > A} 


— where 
- - hle 
Спа = max(1, €, 2 n>1 
ШЕРТЕР 
Со-0 
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CHANGE POINT DETECTION 


e Lemma I 


— The PFA of the CUSUM procedure with mismatched model is 
upper bounded by 


1 | 
А 


РҒА(5,(4)) < 


The mismatched post-change model will not affect the PFA upper bound! 
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CHANGE POINT DETECTION 


* Theorem 1 
- t D(fillfo) - DCfillfi) » 0.let PFA £a. As o — 0 


| log a| 


ADD(6.)  — 29 
a0 D(fillfo) ^ D(fallfi) 
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CHANGE POINT DETECTION 
е ‘Theorem 2 


- If D(fi||fo) — D(fillfi) < 0.Іег РЕА < со < 1, еп 


ADD(6,) — oc 
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CHANGE POINT DETECTION 


Data: two-dimensional 
45| - + - mismatched model (p=0.3) upper bound | | - multivariate Gaussian with 
—tL— mismatched model (p=0.3) simulation | | 
40| "Ө- mismatched model (p=0.4) upper bound : A | 
- 6 - mismatched model (p=0.4) simulation ж | matrix 
- ** - true model (p=0.5) upper bound AE | 
—#— true model (p=0.5) simulation 
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WIND TURBINE BEARING FAULT 


e Direct drive wind turbine 


Generator 
PMrotor  ;' 





Bearings 


Base frame 






Pitch drives 


Generator stator 


( Tower 
Rotor blade 


B. Courtice, "Rare earth magnets: not all new turbines are 
using them.", http://yes2renewables.org/2012/03/06/rare-earth-magnets-not-all-new- 


turbines-are-using-them/, 2012. Online; 
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WIND TURBINE BEARING FAULT 


* Bearing faults 
— Bearing: the part that connects the blade shaft and generator 


— Outer bearing fault: 


— Inner bearing fault: 





X. Gong and W. Qiao, “Current-based mechanical fault detection for direct-drive wind tur- 


bines via synchronous sampling and impulse detection,’ IEEE Trans. Industrial Electron. 30 
vol. 62, no. 3, pp. 1693-1702, 2015 


WIND TURBINE BEARING FAULT 


* Bearing faults 
— Ball fault 
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WIND TURBINE BEARING FAULTS 


* Bearing faults feature frequencies 


— Bearing faults introduce harmonics at different frequencies 1n the 
stator currents 


— Frequencies due to various types of bearing faults 
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WIND TURBINE BEARING FAULTS 
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* Experiment setup 








NI SCXI Data Acquisition System — 





Wind tunnel with wind turbine under testing Data acquisition system 
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WIND TURBINE BEARING FAULTS 


* Experiment setup 





Lubricant on bearing was removed to accelerate degradation 

One of the two bearings was removed to simulate eccentricity 
Wind speed: 0 — 10 m/s 

Sampling frequency: 10 KHz 

Stator current was recorded in 100 second bursts every 20 minutes 


Wind turbine stops rotating after 25 hours 
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WIND TURBINE BEARING FAULTS 


* Data preprocessing: 
— 1. Synchronous resampling 
— 2. Frequency domain feature extraction 


— 3. Energy normalization 
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Sample number 





WIND TURBINE BEARING FAULTS 


* Preprocessing: Synchronous resampling 
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Spectrogram before and after synchronous resampling 
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WIND TURBINE BEARING FAULTS 


e Feature vector in the frequency domain 


LY — ғұ ғұз ye T 
An = E nl: n2, Dn ш. 


— The time is divided into frames, n is the index of frame 


— Each element in the feature vector 1s the amplitude of the stator 
current at a given frequency. 


— E.g. “nj 1$ the amplitude of the current on the j-th frequency 
and in the n-th frame 
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STATISTICAL ANALYSIS 


е Statistical modeling 


— Itis found that the distribution of samples on a given frequency, {т nj m 
can be modeled by the Gamma distribution 


Distribution of outer race FV component 
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STATISTICAL ANALYSIS 


e Parameter estimation 


— Use a sliding window to estimate the parameters of the j-th 
element at the n-th frame 


TL 
Па) 5-37 | 4 2, D 
е Nw +1 I N 
v—IL— IN w 
rl 
l 
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On; nj 


— Assumption: when fault is NOT present, the data at different 
frequencies are 1.1.d. 


iad ~ кы Bn 7 " 9 mj TIL £ n 
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HYPOTHESIS FORMULATION 


* Hypothesis 
Ho: No fault Gamma (a) BO) 
Ну: Fault is present Gamma (aM, B9) 





- Since the power is normalized, = 


ala + 1) 
e Parameter estimation before change point 


— Since the fault will be at one frequency at most. Even 1f the fault 1s 
present, 1t will have very small impact on the estimation of äl ) 
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QUICKEST FAULT DETECTION 


* Challenge: 


The feature vector X, = |2,1, 2,9, :::, Жм” has dimension 
W 


Each dimension represents a frequency 
The fault will happen in only one frequency 


Each frequency is a candidate for faults, and there are multiple 
candidates 


e Solution: Multi-candidate quickest detection 
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QUICKEST FAULT DETECTION 


* Definition: Multi-candidate quickest detection 


— The detection procedure 1s 
0 — inf in: C, 2 A} 
* Where C, = У але 
Съ+1,3 — (1 T C5,5)Àn41, 
C4.; — Аі; 
at? BS?) 


P(@nj3 a 


Ån м RT 
P(@nji C © Bt" ) 
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QUICKEST FAULT DETECTION 


е Theorem | 


— Assume the elements in the feature vector are independent. The 
probability of false alarm of the multi-candidate test procedure is 
upper bounded by 


би 
PFA « — 
TA 


e Where 0 = $n Tkk is the prior mean of the change point 
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QUICKEST FAULT DETECTION 


e Theorem 2 


— Assume the elements in the feature vector are independent, and the 
frames are independent in time. Let PFA < ©. As a — 0, 


1 |loga|+logé + log w 
і-а D(fillfo) 
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EXPERIMENT RESULTS 
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EXPERIMENT RESULTS 
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EXPERIMENT RESULTS 
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CONCLUSIONS 


* Quickest change detection aims at minimizing the 
detection delay subject to certain contstraints, such as PFA. 
— Bayesian detection: Shiryaev procedure 


— Minmax detection: CUSUM procedure, Shiryaev-Roberts 
procedure 


е Identified the performance of CUSUM with mismatched 
post-change modes 
— The PFA upper bound is not affected . 
— The asymptotic ADD upper bound becomes larger. 


е Quickest detection of bearing fault of wind turbine 


— Proposed a new multi-candidate quickest change detection (MC- 
QCD) procedure 


UNIVERSITY OF 48 





REFERENCES - contd. 


[1] W. Qiao and D. Lu, “A survey on wind turbine condition monitoring and fault diagnosis - part 1: Components and 
subsystems,” Industrial Electronics, IEEE Transactions on, vol. 62, по. 10, рр. 6536-6545, 2015. 


[2] N. A. Orlando, M. Liserre, R. A. Mastromauro, and A. Dell’ Aquila, “A survey of control issues in pmsg-based small 
wind-turbine systems," IEEE Transactions on Industrial Informatics, vol. 9, no. 3, pp. 1211-1221, Aug 2013. 


[3] M. Tan and Z. Zhang, "Wind turbine modeling with data-driven methods and radially uniform designs," IEEE 
Transactions on Industrial Informatics, vol. 12, no. 3, pp. 1261-1269, June 2016. 


[4] W. Qiao and D. Lu, “A survey on wind turbine condition monitoring and fault diagnosis - part 11: Signals and signal 
processing methods,” 2015. [5] M. Bl “odt, P. Granjon, B. Raison, and G. Rostaing, “Models for bearing damage detection in 
induction motors using stator current monitoring," Industrial Electronics, IEEE Transactions on, vol. 55, no. 4, pp. 1813- 
1822, 2008. 


[6] B. Lu, Y. Li, X. Wu, and Z. Yang, “A review of recent advances in wind turbine condition monitoring and fault 
diagnosis," in Power Electronics and Machines in Wind Applications, 2009. PEMWA 2009. IEEE. IEEE, 2009, рр. 1-7. 


[7] Z. Daneshi-Far, G. Capolino, and H. Henao, "Review of failures and condition monitoring in wind turbine generators," in 
Electrical Machines (ICEM), 2010 XIX International Conference on. IEEE, 2010, pp. 1—6. 

[8] X. Gong and W. Qiao, “Bearing fault diagnosis for direct-drive wind turbines via current-demodulated signals,” Industrial 
Electronics, [IEEE Transactions on, vol. 60, no. 8, pp. 3419-3428, 2013. 

[9] R. R. Schoen, T. G. Habetler, F. Kamran, and R. Bartfield, “Motor bearing damage detection using stator current 
monitoring," Industry Applications, IEEE Transactions on, vol. 31, по. 6, рр. 1274—1279, 1995. 

[10] F. Immovilli, M. Cocconcelli, A. Bellini, and R. Rubini, "Detection of generalized-roughness bearing fault by spectral- 
kurtosis energy of vibration or current signals,” Industrial Electronics, IEEE Transactions on, vol. 56, no. 11, pp. 4710—4717, 
2009. 

[11] B. M. Ebrahimi, J. Faiz, and M. J. Roshtkhari, “Static-, dynamic-, and mixed-eccentricity fault diagnoses in permanent- 
magnet synchronous motors,” Industrial Electronics, IEEE Transactions on, vol. 56, по. 11, рр. 4727-4739, 2009. 


UNIVERSITY OF 49 
GI ARKANSAS 


REFERENCES - contd. 


[12] W. Yang, P. J. Tavner, and M. Wilkinson, "Condition monitoring and fault diagnosis of a wind turbine synchronous generator 
drive train," Renewable Power Generation, IET, vol. 3, no. 1, pp. 1-11, 2009. 


[13] F. Immovilli, A. Bellini, R. Rubini, and C. Tassoni, "Diagnosis of bearing faults 1n induction machines by vibration or current 
signals: A critical comparison," Industry Applications, IEEE Transactions on, vol. 46, no. 4, pp. 1350-1359, 2010. 


[14] X. Gong and W. Qiao, “Current-based mechanical fault detection for direct-drive wind turbines via synchronous sampling and 
impulse detection," Industrial Electronics, IEEE Transactions on, vol. 62, no. 3, pp. 1693-1702, 2015. 


[15] X. Gong, W. Qiao, and W. Zhou, "Incipient bearing fault detection via wind generator stator current and wavelet filter," in 
IECON 2010-36th Annual Conference on IEEE Industrial Electronics Society. IEEE, 20106, pp. 2615-2620. 


[16] І. S. Bozchalooi and M. Liang, "Parameter-free bearing fault detection based on maximum likelihood estimation and 
differentiation," Measurement Science and Technology, vol. 20, no. 6, p. 065102, 2009. 


[17] H. Ocak and K. A. Loparo, “A new bearing fault detection and diagnosis scheme based on hidden markov modeling of vibration 
signals," in Acoustics, Speech, and Signal Processing, 2001. Proceedings.(ICASSP'01). 2001 IEEE International Conference on, vol. 
5. IEEE, 2001, рр. 3141- 3144. 

[18] X. Zhang, R. Xu, C. Kwan, S. Y. Liang, Q. Xie, and L. Haynes, “An integrated approach to bearing fault diagnostics and 
prognostics," 1n American Control Conference, 2005. Proceedings of the 2005. IEEE, 2005, pp. 2750-2755. 

[19] X. An, D. Jiang, and S. Li, "Application of back propagation neural network to fault diagnosis of direct-drive wind turbine," in 
World NonGrid-Connected Wind Power and Energy Conference (WNWEC), 2010. IEEE, 2010, pp. 1—5. [20] Y. Wang and D. Infield, 
"Neural network modelling with autoregressive inputs for wind turbine condition monitoring," in Sustainable Power Generation and 
supply (SUPERGEN 2012), International Conference on. IET, 2012, pp. 1—6. 

[21] M.-S. An, S.-J. Park, J.-S. Shin, H.-Y. Lim, and D.-S. Kang, "Implementation of automatic failure diagnosis for wind turbine 
monitoring system based on neural network,” in Multimedia and Ubiquitous Engineering. Springer, 2013, pp. 1181-1188. 

[22] А. G. Tartakovsky and G. V. Moustakides, “State-of-the-art in bayesian changepoint detection,’ Sequential Analysis, vol. 29, no. 
2, рр. 125-145, 2010. [23] J. Wu and J. Yang, “Quickest change detection with mismatched postchange models,” arXiv preprint 
arXiv: 1601.06868, 2016. 


UNIVERSITY OF 50 
GI ARKANSAS 


